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[i]  The  impact  of  global  Navy  Layered  Ocean  Model  (NLOM)  sea  surface  height 
(SSH)  on  global  Navy  Coastal  Ocean  Model  (NCOM)  nowcasts  of  ocean  currents  is 
investigated  in  a  series  of  experiments.  The  studies  focus  on  two  primary  aspects:  the  role 
of  NLOM  horizontal  resolution  and  the  role  of  differences  between  the  SSH  means  in 
NLOM  and  the  Modular  Ocean  Data  Assimilation  System  (MOD AS)  climatology.  To 
evaluate  the  impact  of  changes  to  the  assimilation  system,  we  compare  observed  drifter 
trajectories  with  trajectories  simulated  using  global  NCOM  over  7-day  timescales.  The 
results  indicate  general  improvement  in  NCOM  currents  as  a  result  of  increasing  NLOM 
horizontal  resolution.  The  effects  of  accounting  for  the  differences  between  NLOM  and 
MODAS  mean  that  SSH  is  less  clear,  with  some  regions  showing  a  decline  in  simulation 
skill  while  others  show  improvement  or  little  impact  These  outcomes  supported 
recommendations  for  operational  transition  to  1/32°  global  NLOM  with  continued 
refinement  to  methods  accounting  for  differences  in  mean  SSH. 
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1.  Introduction 

[2]  Different  ocean  modeling  system  formulations  are 
evaluated  by  comparing  simulated  drifter  trajectories  using 
model  currents  with  corresponding  independent  drifter 
observations.  Time- integrated  near-surface  movement  of 
water  from  one  location  to  another  is  naturally  measured 
through  Lagrangian  drifters.  Numerous  studies  use  sets  of 
drifters  to  identify  climatological  circulation  patterns  and 
modes  of  variability  [Poulain,  1999;  Fratantoni,  2001; 
Reverdin,  et  ai ,  2003;  Zhurhas  and  Oh,  2003],  Others 
develop  more  comprehensive  climatological  depiction  by 
supplementing  actual  drifter  observations  with  trajectories 
simulated  in  numerical  models.  Lugo-Fernandez  et  ai 
[2001]  used  real  and  simulated  drifters  as  a  proxy  for 
dispersal  of  coral  larvae  from  the  Flower  Garden  Banks. 
Naimie  et  ai  [2001]  combines  3  years  of  observations  from 
155  drifters  with  trajectories  simulated  by  a  climatologically 
and  tidally  forced  model.  The  resulting  data  set  averages 
680  observational  days  of  measured  trajectories  per  month. 
Statistics  from  these  data  are  compared  with  results  based 
on  simulated  monthly  drifter  deployments  in  the  model. 
Many  differences  between  the  model  and  observational 
records  are  linked  to  episodic  wind  events  not  represented 
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in  the  climatological  forcing.  Similar  errors  in  daily  forecasts 
arise  from  atmospheric  events  poorly  resolved  or  otherwise 
not  represented  by  the  global  atmospheric  models.  Studies 
also  use  observed  trajectories  to  validate  predictions  of 
surface  currents,  Vastano  and  Barron  [1994]  evaluate  24- 
hour  trajectories  based  on  surface  circulation  determined  by 
tracking  features  in  satellite  imagery*  while  Thompson  et  ai 
[2003]  examine  simulated  trajectories  up  to  100  hours  on 
the  shelf  off  Nova  Scotia. 

[3]  Accuracy  of  drifter-based  estimates  of  water  move¬ 
ment  depends  upon  the  accuracy  in  determining  the  location 
of  a  drifter  and  the  slip  of  the  drifter  relative  to  the  actual 
water  movement  at  the  drifter  location.  Hansen  and  Herman 
[1989]  found  that  for  the  commonly  used  drifters  with  10  or 
30  m  “window  shade'"  drogues*  at  best*  a  daily  mean 
velocity  accuracy  of  2-3  cm  $"1  could  be  expected*  with 
the  standard  rate  of  Argos  communications  from  two 
satellites*  within  the  5  cm  s'1  Tropical  Ocean  Global 
Atmosphere  (TOGA)  standard.  By  attaching  neutrally  buoy¬ 
ant  current  meters  to  the  top  and  bottom  of  15  m  holey  sock 
and  TRISTAR  drogues*  Niiler  et  ai  [1995]  found  slippage 
errors  of  0.5 -3. 5  cm  s"1.  While  careful  reprocessing  can 
reduce  errors  below  0.5  km/day,  the  typical  2-to3.5cms“* 
errors  in  the  daily  mean  current  are  equivalent  to  a  separa¬ 
tion  error  of  1-3  km  day~\  with  a  4.3  km  day^1  error 
equivalent  to  the  TOGA  standard. 

[4]  The  predictability  of  drifter  trajectories  depends  not 
only  on  the  accuracy  with  which  drifters  represent  water 
parcel  advection  but  also*  often  more  importantly*  on  the 
dispersion  of  closely  spaced  water  parcels*  a  process  which 
may  not  be  resolved  on  the  space  and  timescales  sampled  by 
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Table  1.  Numerical  and  Observational  Error  Estimates  for 
Predicting  Drifter  Trajectories0 


RMS  Prediction  RMS  Prediction 

Error  After 

Ettot  After 

Region  ffv* 

cm  s  1 

3  Days,  km 

7  Days,  km 

Numerical  results  from  the  work  of  Ozgohnen  et  al  [20001 

Gyre  interior 

2,8 

0.4 

1.7 

Western  boundary 

12 

3.0 

10.9 

Midlatitude  jet 

28 

14.6 

67.4 

Observational  (tropical  Pacific)  results  from  the  study  of 

Ozgohnen  et  al.  [2001  ] 

Cluster  1 

24 

7 

10 

Cluster  11 

31 

10 

15 

Cluster  ID 

54 

20 

65 

''The  numerical  results  correspond  to  the  minimum  (0.25°  x  0.259) 
spacing  of  simulated  drifters.  The  observational  results  correspond  to  the 
prediction  error  using  the  maximum  6- hourly  data  assimilation  during  the 
firsi  7  days  after  deployment,  the  period  of  maximum  duster  density. 


the  observations  or  models  to  be  evaluated.  Even  if  a  model 
accurately  represents  ocean  velocity,  the  model’s  discrete 
sampling  of  the  ocean  will  lead  to  differences  in  the 
simulated  trajectories.  As  the  distance  between  predicted 
and  true  drifter  position  increases,  the  trajectories  sample 
increasingly  uncorrelated  environmental  conditions  that 
tend  to  increase  separation  distance. 

[5]  Predictability  of  Lagrangian  trajectories  has  been 
examined  using  observed  and  modeled  drifters.  A  model 
study  by  Ozgohnen  et  a  l  [2000]  indicates  that  error  in 
predicted  drifter  position  tends  to  increase  over  time  at  a  rate 
proportional  to  the  square  root  of  the  velocity  variance 
c Ty ,  where  the  velocity  variance  is  the  sum  of  the  variances 
of  the  east  (11)  and  north  (v)  velocity  components, 
o\  —  The  variances  are  calculated  relative  to  a 

spatial  and  temporal  mean.  Uniformly  seeded  drifters  in  an 
idealized  double-gyre  circulation  model  are  sampled  in 
three  domains:  the  gyre  interior,  the  western  boundary 
current,  and  the  midlatitude  jet.  Drifter  velocities  are  pre¬ 
dicted  as  a  linear  combination  of  the  velocities  of  neigh¬ 
boring  particles  weighted  by  the  expected  covariance. 
Sampling  at  higher  density  reduces  the  distance  between 
the  modeled  trajectory  and  its  nearest  neighbors,  thereby 
increasing  the  skill  of  predictions  that  assimilate  neighbor¬ 
ing  trajectories.  Table  l  shows  their  numerical  results  at  the 
highest  sampling  density  of  0.25°  x  0,25°.  Observational 
results  from  the  study  of  Ozgohnen  et  al  [2001]  are 
included  in  Table  I  as  well,  This  subsequent  study  uses 
three  clusters  of  World  Ocean  Circulation  Experiment 
(WOCE)  drifters  in  the  tropical  Pacific,  clusters  that  are 
within  5°  latitude  of  the  equator  and  are  distinct  from  the 
gyre  regions  in  the  prior  examination.  Various  methods  are 
investigated  to  predict  drifter  trajectories;  the  results  con¬ 
sidered  here  are  from  the  method  determined  to  be  most 
accurate,  predicting  a  drifter  trajectory  using  a  Kalman  filter 
to  assimilate  6-hourty  velocities  sampled  from  the  other 
duster  members.  For  the  highest -density  clusters  immedi¬ 
ately  after  deployment,  root  mean  square  (RMS)  prediction 
errors  for  the  assimilative  method  remained  <15  km  for 
about  7  days  for  the  first  two,  less  energetic  clusters  (ov 
between  24  and  31  cm  s_l);  RMS  error  in  the  more 
energetic  (ay  =  54  cm  $“l)  third  cluster  grew  to  20  km  by 
the  fourth  day  and  exceeded  65  km  by  day  7.  These  studies 


provide  a  drifter  predictability  baseline  error  that  is  roughly 
proportional  to  the  square  root  of  velocity  variance.  When 
evaluating  drifter  trajectories  simulated  by  a  model,  errors 
inherent  in  predicting  Lagrangian  trajectories  are  com* 
pounded  by  errors  in  the  model  velocity  field.  Many 
comparisons  with  observations  are  needed  to  allow  confi¬ 
dence  in  the  conclusions  of  such  a  study, 

[6]  In  this  report,  we  evaluate  the  impact  of  model  system 
modifications  on  surface  circulation  by  regionally  comparing 
simulated  drifters  with  trajectories  from  a  yearlong  global 
set  of  Lagrangian  observations.  A  description  of  the  models 
is  given  in  section  2,  while  section  3  provides  an  overview 
of  the  experiments.  Data  and  methods  are  covered  in 
section  4,  and  section  5  discusses  the  results. 

2.  Models 

[7]  As  presented  in  the  paper  of  Rhodes  et  al.  [2002],  the 
global  ocean  model  suite  developed  by  the  U.S.  Naval 
Research  Laboratory  (NRL)  and  run  operationally  by  the 
U.S.  Naval  Oceanographic  Office  has  three  components:  the 
Navy  Layered  Ocean  Model  (NLOM),  the  Modular  Ocean 
Data  Assimilation  System  (MODAS),  and  the  Navy  Coastal 
Ocean  Model  (Figure  1).  This  NRL  Global  Ocean  Modeling 
System  (NGOMS)  endeavors  to  make  more  efficient  use  of 
operational  computational  resources  by  leveraging  the 
strengths  and  capabilities  of  the  system  elements.  Different 
NGOMS  formulations  are  evaluated  by  comparing  simu¬ 
lated  drifter  trajectories  using  NCOM  currents  with  inde¬ 
pendent  drifter  observations, 

[s]  Designed  to  provide  high-fidelity  forecasts  of  deep¬ 
water  front  and  eddy  location,  global  NLOM  emphasizes 
high  horizontal  resolution  at  the  expense  of  coarse  (seven - 
layer)  vertical  resot ution  and  coverage  only  for  sub* Arctic 
regions  deeper  than  200  m  [Wall craft  et  al. ,  2003].  NLOM 
must  maintain  all  of  its  layers  at  nonzero  thickness 
throughout  its  domain,  a  consequence  of  approximations 
that  greatly  increase  computational  efficiency.  Thus  its 
layers  must  neither  surface  nor  intersect  bottom  topography, 
leading  to  the  deepwater  restriction.  The  original  operational 
global  NLOM  in  NGOMS  V2.0  [Smedstad  et  al ,  2003]  was 
configured  with  1/16°  midlatitude  horizontal  resolution;  for 
the  upgrade  to  NCOMS  V2.5,  NLOM  horizontal  resolution 
has  been  increased  to  1/32°  [Shriver  et  al ,  2007], 

[9]  Global  NCOM  extends  over  continental  shelves, 
coastal  regions,  and  the  Arctic,  providing  global  coverage 
with  minimum  bottom  depth  of  5  m.  Described  in  detail  by 
Barron  et  al  [2006],  global  NCOM  maintains  fairly  high 
vertical  resolution  using  40  logarithmically  stretched  mate¬ 
rial  levels  in  the  vertical:  19  terrain- following  sigma  levels 
in  the  upper  141  m  or  shallower  over  21  z  levels  extending 
to  a  maximum  5500-m  depth.  The  uppermost  level  has  a 
rest  thickness  of  1  m  in  the  open  ocean,  Barron  et  al 
[2004]  and  Kara  et  al  [2006]  evaluate  nonassimUative  and 
NGOMS  2.0  versions  of  global  NCOM  through  compar¬ 
isons  with  unassimilated  ocean  observations  including  sur¬ 
face  observations  of  height  (SSH),  temperature  (SST),  and 
salinity  and  subsurface  observations  of  mixed  layer  depth, 
temperature,  and  salinity.  While  global  NCOM  has  relatively 
high  vertical  resolution,  its  horizontal  resolution  is  limited 
to  1/8°  to  fit  within  the  limits  of  its  operational  computa¬ 
tional  resources.  On  this  relatively  coarse  grid,  NCOM  is 
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Figure  L  Wiring  diagram  of  the  NRL  Global  Ocean  Modeling  System,  adapted  from  the  work  of 
Rhodes  et  al  [2002],  showing  the  relationship  between  NLOM,  MODAS,  and  NCOM*  Two  numbered 
dements  indicate  modifications  to  the  standard  configuration,  which  are  evaluated  in  this  article: 
(1)  changing  the  resolution  of  global  NLOM  from  1/16°  to  1/32°  and  (2)  accounting  for  the  difference 
between  the  NLOM  and  MODAS  SSHA.  Rectangle  (3)  indicates  the  global  NCOM  results  evaluated  in 
this  study.  NGOMS  V2,0  uses  the  1/16°  NLOM,  while  V2.5  incorporates  NLOM  at  1/32°, 


eddy-permitting  but  only  marginally  eddy-resolving,  lack¬ 
ing  the  horizontal  resolution  needed  to  robustly  forecast 
the  longer-term  dynamic  evolution  of  mesoscale  fronts  and 
eddies  [Hurlburt  and  Hogan ,  2000].  Through  assimilation, 
NCOM  is  able  to  maintain  a  reasonably  accurate  represen¬ 
tation  of  fronts  and  eddies,  and  it  thereby  adequately 
provides  boundaiy  conditions  for  higher-resolution  nested 
models. 

[io]  The  assimilation  that  leverages  the  high  horizontal 
resolution  of  NLOM  and  that  allows  the  extended  coverage 
of  NCOM  must  allow  the  global  system  to  complete  daily 
integrations  within  limited  operational  computational  con¬ 
straints.  While  more  sophisticated  variational  techniques  are 
under  investigation  to  improve  solution  accuracy,  a  simple, 
low-cost  relaxation  has  been  initially  used  for  the  time- 
critical  operational  system.  In  this  system,  SSH  is  not 
assimilated  directly  but  is  instead  used  to  derive  profiles 
of  temperature  and  salinity  for  assimilation,  SST  from  the 
global  MODAS-2D  analysis  [Barron  and  Kara ,  2006]  and 
the  sea  surface  height  anomaly  (SSHA)  from  global  NLOM 
are  projected  in  the  vertical  using  the  MODAS  dynamic 
climatology  [Fox  et  al 2002]  to  make  three-dimensional 
fields  of  temperature  and  salinity.  Note  that  salinity  is 
determined  from  temperature  using  local  climatological  T-S 
curves;  if  estimates  of  surface  salinity  were  available,  these 
would  be  used  to  produce  more  accurate  salinity  profiles. 
Blended  in  the  Arctic  with  the  monthly  Generalized  Digital 
Environmental  Model  (GDEMV  3.0)  [Teague  et  al .,  1990] 
climatology,  the  resulting  global  temperature  and  salinity 


files  are  assimilated  at  each  time  step  Into  the  NCOM 
solution  using  slow  data  insertion, 

r(x,y,2,/)  =  {I  -<2))TN(x,y,^,|)  +  (i(2)rM(x,y,x,f)  (l) 


«(*)  =  (2A(/t)^1  -e"l1/6^  {2) 

where  T is  the  post-assimilation  temperature  (or  salinity),  7^ 
is  the  NCOM  result  before  assimilation,  and  TM  is  the 
MODAS  temperature  (or  salinity)  interpolated  to  time  /, 
depth  z,  and  horizontal  location  x,  y .  The  assimilation 
weight  for  each  time  step  a(z)  depends  on  the  ratio  of  the 
time  step  A t  to  the  relaxation  timescale  r  and  the  ratio  of 
the  grid  point  depth  z  to  the  relaxation  depth  scale  b.  For  the 
results  in  this  study,  b  is  200  m.  At  is  5  min,  and  r  is 
48  hours. 

3,  Experiments 

[n]  The  experiments  evaluated  in  this  study  focus  on  the 
use  of  high -resolution  SSH  fields  from  NLOM  within 
1/8°  global  MODAS  to  produce  synthetic  temperature  and 
salinity  profiles  for  assimilation  into  global  NCOM.  The 
experiments  have  two  variables:  the  version  of  NLOM  used 
to  calculate  SSH,  and  the  optional  inclusion  of  a  correction 
term  that  accounts  for  systematic  differences  between 
NLOM  and  MODAS  anomalies.  As  indicated  by  label  (1) 
in  Figure  1,  the  high-resolution  SSH  for  MODAS  is 
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produced  by  either  1/16°  or  1/32°  global  NLOM.  However, 
MODAS  does  not  use  the  total  NLOM  SSH;  MODAS 
expects  the  SSH  it  provided  to  be  equivalent  to  an  offset 
from  the  steric  height  anomaly  relative  to  1000  m  in  the 
MODAS  hydrographic  climatology  [Boehel  and  Barron, 
2003].  In  general,  the  SSH  observed  by  altimeters  or 
simulated  in  an  ocean  model  is  a  combination  of  steric 
and  nonsteric  components;  Shriver  and  Hurlburt  [2000] 
find  that  the  nonsteric  component  contributes  over  50%  of 
the  total  SSH  variability  for  more  than  37%  of  the  global 
ocean.  They  also  describe  how  the  abyssal  pressure 
anomaly  can  be  used  to  determine  SSHN,  the  nonsteric 
contribution  to  SSH.  Subtracting  the  nonsteric  SSHN  from 
the  total  SSH  produces  SSHB,  a  steric  (sometimes  referred 
to  a  baroclinic)  component  of  the  NLOM  SSH.  The 
NLOM  estimate  for  steric  SSH  anomaly  is  calculated  by 
SSHAnlom  =  SSHB  -  SSHB,  where  SSHB  is  the  long¬ 
term  mean  of  SSHB  at  each  point  The  SSHA  provided  to 
MODAS  to  calculate  temperature  and  salinity  profiles  is 
given  by 


SSHA  =  SSHB  -  SSHB  +  (SSHAmodas  -  SSHAnlom)-  (3) 

The  SSHA  correction  term  (SSHAMOdas  -  SSHAnlom)  iS 
designated  (2)  in  Figure  L  We  approximate  the  SSHA 
correction  using  the  difference  between  SSHB  from  the 
1/16°  NLOM  and  the  climatological  MODAS  steric  height 
anomaly  integrated  from  2500  m  or  the  bottom  to  the 
surface.  The  SSHA  from  equation  3  is  used  with  the 
MODAS  SST  analysis  to  derive  temperature  and  salinity 
profiles  for  NCOM  assimilation  as  described  above, 

[12]  Table  2  indicates  the  experiments  examined  in  this 
report.  The  control  experiment  is  the  original  operational 
three-component  NGOMS  V2.0  with  1/16°  global  NLOM 
and  no  (SSH  A  modas”  SSHAnlom)  correction  term.  We 
would  like  to  determine  whether  some  alternative  formula¬ 
tions  lead  to  improved  system  performance.  Such  a  deter¬ 
mination  requires  a  broad  validation  study  examining  many 
aspects  of  the  model  results;  results  of  such  a  study  were 
reported  in  the  paper  of  Barron  et  ai  [2004]  and  Kara  et  al 
[2006]  for  V2,0.  To  support  an  upgrade  decision,  similar 
evaluations  have  been  made  using  the  alternative  model 
system  formulations.  This  paper  focuses  on  one  aspect  of  a 
comprehensive  system  validation  study:  the  accuracy  of 
predicted  drifter  trajectories. 

[n]  What  are  the  system  alternatives,  and  why  do  we 
expect  that  these  might  be  improvements?  V2.0a  uses  the 
same  model  components  but  incorporates  a  SSH  correction 
term  that  attempts  to  account  for  differences  between  the 
mean  NLOM  SSH  and  the  mean  MODAS  SSH.  We  expect 
that  by  accounting  for  this  difference,  the  MODAS  will  be 
able  to  project  SST  and  NLOM  SSH  more  accurately  into 
synthetic  temperature  and  salinity  profiles.  Assimilation  of 
these  more  accurate  profiles  by  global  NCOM  should 
increase  the  fidelity  of  model  circulation  and  should  lead 
to  more  accurate  trajectory  predictions.  A  different  modifi¬ 
cation  is  incorporated  in  experiment  V2.5,  the  second- 
generation  operational  NGOMS:  SSHANLOm  from  1/16° 
NLOM  is  replaced  with  the  1/32°  NLOM  version.  We 
expect  that  increasing  NLOM  resolution  leads  to  a  better 


Table  2,  NRL  Global  Ocean  Modeling  System  Experiments'1 


Experiment 

SSHB 

SSHB 

(SSHA  MODAS  -  SSHA  klom) 

V2.0 

i/J6D  NLOM 

1/16"  NLOM 

0 

V2.5 

1/32°  NLOM 

1/32°  NLOM 

0 

V2.0a 

mt°  NLOM 

1/16"  NLOM 

Based  on  1/16*  NLOM 

V2.5a 

m2a  NLOM 

1/32°  NLOM 

Based  on  1/16°  NLOM 

Persist 

No  motion:  Predicted  position  is  always  the  initial  location 

Clim 

Motion  using  the  mean  1998 

-2001  currents  from  V2.0 

*V2,Q  is  the  original  operational  three-component  NGOM  system,  while 
V2.5  is  the  second-generation  version,  SSHA  =  SSHB  -  SSHB  - 
(SSHAModas  —  SSHANLom)- 


representation  of  true  SSH,  thus  leading  to  a  more  accurate 
distribution  of  temperature  and  salinity  in  the  resulting 
MODAS  profiles  and  finally  more  accurate  circulation  in 
global  NCOM.  V2.5a  pairs  the  mean  SSH  correction  term 
from  V2.0a  with  the  SSHANLOm  from  1/32°  NLOM  used  in 
V2,5.  Reference  system  performances  are  evaluated  using  a 
persistence  case,  which  assumes  that  velocities  are  uniformly 
zero,  and  the  clim  case,  which  approximates  drifter  motion 
based  on  the  2000-2002  mean  currents  NCOM  from  V2.0 
NGOMS, 

[14]  What  are  the  impacts  of  assimilation  and  the  SSHA 
correction  term  on  the  currents  simulated  by  global 
NCOM?  The  NCOM  fields  evaluated  are  indicated  by 
label  (3)  in  Figure  L  Results  for  the  Kuroshio  east  of 
Japan  are  shown  in  Figure  2,  Assimilation  of  the  MODAS 
profiles  maintains  tighter  density  gradients,  transforming 
the  weak  Kuroshio  extension  simulated  in  the  nonassimi- 
lative  case  (Figure  2a)  into  a  much  more  robust,  realistic 
current  in  NGOMS  V2.5  (Figure  2b).  The  SSHA  correction 
term  (Figure  2c)  indicates  that  the  NLOM  mean  SSH  is 
generally  higher  than  the  MODAS  mean  south  of  the 
Kuroshio,  or,  equivalently,  that  the  SSHAMqDAS  in  these 
areas  is  more  positive  than  a  corresponding  SSHAnlom- 
Thus  a  height  offset  should  be  added  to  SSHAnlom  in 
these  regions  to  produce  a  correct  estimate  of  SSHA  in 
computing  a  MODAS  synthetic  profile.  Inclusion  of  the 
SSHA  correction  term  strengthens  density  gradients  and 
current  speeds  (Figure  2d),  particularly  near  165°E.  Assimi¬ 
lation  leads  to  a  more  realistic  representation  of  the  Kur- 
oshio  extension,  and  inclusion  of  the  SSHA  correction 
factor  provides  additional  benefit. 

[15]  While  assimilation  of  synthetic  profiles  generally 
brings  NCOM  into  closer  agreement  with  observed  circula¬ 
tion  conditions,  results  in  the  Alaska  Stream  (Figure  3)  reflect 
dynamics  inadequately  represented  in  the  present  approach. 
In  the  nonass i mil ative  global  NCOM  case.  Figure  3a,  a 
robust  Alaska  Stream  is  evident  at  150  m,  in  agreement 
with  historical  observations  [C/ich  and  Firing ,  2006], 
Assimilation  in  NGOMS  V2.5  (Figure  3b)  and  in  NGOMS 
V2.0  (not  shown)  greatly  reduces  this  current,  indicating 
that  the  assimilated  MODAS  synthetic  profiles  in  this 
experiment  do  not  have  the  correct  vertical  structure.  One 
contributing  factor  is  the  MODAS  linkage  between  subsur¬ 
face  temperature  and  salinity,  A  halocline  that  is  not 
correlated  with  a  thermocline,  a  feature  of  the  Alaska 
Stream  [Chen  and  Firing,  2006],  is  not  adequately  repre¬ 
sented  by  the  MODAS  approach,  which  estimates  a  tempe¬ 
rature  profile  alone  and  then  projects  salinity  as  a  function 
of  temperature,  A  second  difficulty  arises  if  the  location  or 
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Figure  2.  Impact  of  data  assimilation  and  (SSHAmodas  -  SSHANLOm)  correction  term  in  the  Kuroshio 
region.  Figures  2a,  2b,  and  2d  depict  current  vectors  superimposed  on  current  speed  at  1 50  m  depth  from: 
(a)  1998-2000  nonassimilative  global  NCOM  mean,  (b)  2003  V2,5  NCOM  mean,  and  (d)  2003  V2,5a 
NCOM  mean.  Figure  2c  is  the  height  correction  term  in  centimeters  to  covert  from  V2.5  to  V2,5a  (or 
V2.0  to  V2*0a),  Assimilation  produces  tighter  density  gradients,  transforming  weak  Kuroshio  extension 
simulated  in  the  nonassimilative  case  into  a  more  robust,  realistic  current  in  V2.0.  Inclusion  of  the  SSHA 
correction  term  strengthens  density  gradients  and  current  speeds,  particularly  near  165°E. 


gradients  of  the  front  differ  between  NLOM  and  MOD  AS, 
The  latter  source  of  error  is  addressed  by  addition  of  the 
SSHA  correction  term,  (SSHAmodas  -  SSHANLOm),  as 
shown  in  Figure  3c.  In  this  case,  the  SSHB  mean  in  NLOM 


is  low  relative  to  the  MODAS  mean,  indicating  that  a  more 
negative  SSHA  should  be  used  to  calculate  synthetic 
profiles.  While  unable  to  address  the  halocline  deficiency, 
the  correction  term  in  Figure  3c  mitigates  the  assimilation 


Figure  3.  Impact  of  data  assimilation  and  (SSHAModas-SSHANLom)  correction  term  in  the  Alaska 
Stream  region.  Figures  3a,  3b  and  3d  depict  current  vectors  superimposed  on  current  speed  at  150  m 
depth  from:  (a)  1998-2000  nonassimilative  global  NCOM  mean,  (b)  2003  V2J  NCOM  mean,  and 
(d)  2003  V2.5a  NCOM  mean.  Figure  3c  is  the  height  correction  term  in  centimeters  to  covert  from  V2.5 
to  V2.5a  (or  V2.0  to  V2,0a),  Errors  due  to  a  nonzero  (SSHAmodas-SSHANlgm)  reinforce  MODAS 
errors  in  representing  haloclines  uncorrelated  with  thermoclines,  greatly  weakening  the  Alaska  Stream  in 
V2.5.  While  not  addressing  the  halocline  deficiency,  the  correction  term  in  Figure  3c  mitigates  the 
assimilation  errors  somewhat  in  Figure  3d  and  allows  a  more  realistic  depiction  of  the  Alaska  Stream. 
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errors  in  NLOM  V2.5a  {Figure  3d),  leading  to  a  more 
realistic  representation  of  the  Alaska  Stream, 

4,  Data  and  Evaluation 

[i&]  Numerous  categories  of  validation  metrics  could  be 
applied  to  assess  the  relative  performance  of  the  various 
model  experiments.  This  article  focuses  on  the  use  of 
observed  and  simulated  drifter  trajectories  to  evaluate  rela¬ 
tive  model  performance  in  Lagmngian  movement  of  water. 
To  do  the  evaluation,  we  simulate  7*day  drifter  trajectories 
initialized  collocated  with  observed  drifters.  Our  perfor¬ 
mance  metric  for  each  simulated  drifter  is  its  time-varying 
separation  from  its  observed  counterpart. 

[n]  Observed  drifter  trajectories  are  acquired  from  the 
National  Oceanic  and  Atmospheric  Administration  (NOAA) 
Global  Drifter  Program  (GDP).  These  data  are  accessible  at 
www.aoml. noaa.gov/phod/dac/dacdata,  html  via  the  GDP 
Drifter  Data  Assembly  Center,  Interpolation  of  the 
WOC E-TOGA  surface  velocities  to  uniform  6-hour  interval 
trajectories  is  described  in  detail  by  Hansen  and  Poulain 
[1996].  Details  on  the  drifters  and  the  processing  of  the 
drifter  data  may  be  found  in  the  study  of  Lumpkin  and 
Pazos  [2007], 

[ih]  Simulated  trajectories  are  based  on  velocity  fields 
archived  from  the  model  experiments  for  2003  and  are 
derived  using  a  method  adapted  from  the  work  of  Vastano 
and  Barron  [1994].  Although  the  observed  drifters  have  a 
drogue  centered  at  15  m  depth,  we  opt  for  the  surface 
velocity  field  because  it  was  archived  every  3  hours,  while 
the  interval  between  samples  of  the  full  three-dimensional 
velocity  field  was  twice  as  long.  Simulations  are  calculated 
in  year  2003  for  30  selected  regions  (Table  3)  of  the  global 
ocean.  We  also  report  ov  for  each  region  in  Table  3  using 
the  V2.0  NCGM  time  series  to  calculate  velocity  variance  as 
a  regional  spatial  and  temporal  mean  value. 

[19]  In  each  region,  we  identify  the  locations  of  observed 
drifters  at  0:00  UCT,  Starting  from  these  locations,  we 
integrate  the  drifter  trajectories  over  7  days  using  a  fourth- 
order  Runge-Kutta  method  [Press  et  al 1986]  with  a  1-hour 
time  step  and  multilinear  time-space  interpolation  of  the 
3-hourly  surface  velocity  fields. 

[20]  Examples  of  7-day  simulated  and  observed  drifter 
trajectories  are  shown  in  Figure  4.  Two  panels  (Figures  4a 
and  4b)  show  trajectories  initialized  on  10  December  2003. 
These  plots  reveal  the  irregular  spatial  and  temporal  sam¬ 
pling  of  the  drifter  observations  and  reflect  an  above- 
average  number  of  drifters  in  these  regions.  For  example, 
within  the  East  Asian  Pacific  region,  the  Yellow  Sea  and 
central  East  China  Sea  tend  to  have  fewer  observations  than 
does  the  Kuroshio  between  Taiwan  and  Japan.  The  latter 
two  panels  show  a  pair  of  drifters  near  the  Gulf  Stream  off 
Cape  Hatteras  initialized  on  consecutive  days,  24  January 
(Figure  4c)  and  25  January  (Figure  4d)  2003.  Trajectory 
predictions  for  the  northeastern  drifter  seem  highly  corre¬ 
lated  between  the  2  days,  while  predictions  for  the  south¬ 
western  drifter  would  show  very  low  correlation  from  1  day 
to  the  next  We  treat  comparisons  initialized  on  consecutive 
days  from  a  common  observed  trajectory  as  independent 
observations,  an  assumption  that  is  more  valid  in  some 
(low-correlation)  cases  than  in  others. 


Table  3,  Latitude  Range,  Longitude  Range,  and  Oy  for  Regions 
Used  in  the  Study 

Region 

Lat,  Range 

Long. 

Range 

fr(4  cm  s  1 

Agulhas 

45*- 

25'S 

0°  - 

50*E 

34 

Australia-New  Zealand 

57°- 

1 8°S 

]  45*E- 

170*W 

25 

Arabian  Sea 

5°S- 

35°N 

30*- 

85  °E 

38 

Eastern  North  Pacific 

15*- 

65°N 

170*- 

93  *W 

22 

Benguela  Current 

35*S- 

0“N 

0*- 

30°E 

24 

Black  Sea 

40°  - 

47®N 

25*- 

43  *E 

24 

Brazil  Malvinas  Confluence 

45*- 

5°S 

60*- 

10°W 

23 

Celtic-Bi scay-Nonh  Sea 

47°- 

65°N 

25*W 

10°E 

19 

Central  Pacific 

10*- 

50'N 

160*E“ 

140°W 

26 

East  Asian  Pacific 

5°- 

41^ 

105°- 

135°E 

34 

Equatorial  Atlantic 

20°S- 

20°  N 

55°W  - 

15*E 

29 

Equatorial  Pacific 

20°S- 

20°  N 

U8°E- 

K0*W 

32 

Gulf  Stream 

20°- 

•45°N 

85*- 

65  *W 

38 

Gulf  of  Alaska 

30*- 

62°N 

1 80*  - 

1 28*  W 

23 

Gulf  of  Guinea 

10°S- 

25°N 

22*W- 

15*E 

28 

Gulf  of  Mexico 

lS°-3rN 

98*- 

75*W 

38 

Humboldt  Current 

60°S- 

0*N 

100*- 

60*W 

21 

intra  Americas  Seas 

5°- 

3l*N 

100*- 

55*W 

33 

Iberia  Region 

30*- 

47*N 

20*  W  - 

D*E 

19 

Indian  Ocean 

30*S- 

■25*N 

20*- 

I10*E 

32 

Java  Sea 

20°S- 

■5*N 

95*- 

]  45*E 

32 

Kuroshio 

25*- 

■45°N 

125*- 

180°E 

35 

Madagascar 

28*  - 

10°S 

40*  - 

53*E 

34 

North  Atlanlic 

0°- 

80*  N 

100° - 

0*W 

29 

North  Brazil  Current 

0*“ 

20°  N 

70° - 

40*W 

36 

Pacific  Islands 

35*  S- 

30*N 

I30°E- 

I45*W 

29 

South  China  Sea 

0*- 

30*N 

99°- 

125*E 

30 

Japan.1  East  Sea 

34° - 

48*  N 

127°- 

143*E 

30 

Taiwan 

21*- 

■33=74 

U5°- 

1 43*£ 

35 

Tehuantepec 

5 

■32*N 

150c- 

80*  W 

30 

[21]  Prediction  error  is  evaluated  by  calculating  every 
6  hours  the  separation  in  kilometers  between  observed  and 
simulated  trajectories,  starting  at  0:00  for  each  day  and 
continuing  over  7  days  for  each  trajectory.  Error  is  zero  at 
0:00  for  the  first  day  of  each  trajectory.  Trajectories  are 
initialized  only  for  the  first  359  days  of  2003,  allowing  each 
to  potentially  reach  its  full  7-day  extent  in  2003.  Compar¬ 
isons  are  made  over  periods  shorter  than  7  days  if  a  drifter 
ceases  transmitting  or  leaves  the  evaluation  region.  Thus, 
the  number  of  observations  used  in  the  statistical  calcula¬ 
tions  tends  to  decrease  as  the  integration  time  increases. 

5.  Results 

[22]  Results  of  the  drifter  comparisons  after  24  hours 
(1  day)  and  1 68  hours  (7  days)  of  integration  are  summa¬ 
rized  in  Tables  4  and  5.  The  evaluation  regions  are  sorted  by 
increasing  av.  The  top- perform  mg  experiments  arc  identi¬ 
fied  by  italics,  and  the  percentage  of  regions  for  which  each 
experiment  was  the  top-  or  one  of  the  two  top-performing 
experiments  is  recorded  on  the  bottom  two  rows.  The  final 
column  indicates  the  number  of  observed  simulated  drifter 
pairs  contributing  to  the  regional  statistic. 

[23]  An  alternative  summary  of  the  comparisons  is  pre¬ 
sented  in  Figure  5.  This  is  a  table  of  figure  panels,  sorted 
into  columns  of  increasing  length  of  trajectory  integral  ion 
(1  and  7  days)  and  into  rows  of  generally  increasing  model 
performance.  Each  plot  compares  the  results  from  one  of 
five  experiments  (persistence,  climatology,  V2,0,  V2.0a, 
and  V2.5a)  with  the  results  from  the  overall  best  case, 
V2.5,  Each  panel  also  shows  a  linear  fit  to  the  data,  which 
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Figure  4.  Comparisons  between  observed  drifter  trajectories  (green)  and  simulated  trajectories 
(magenta)  integrated  using  3-hourly  NCOM  surface  velocities  from  NGOMS  V2.5a.  A  cross  marks  each 
starting  location,  while  diamonds  indicate  each  observed  or  simulated  drifter  location  7  days  later  Panels 
for  the  (a)  East  Asian  and  (b)  Gulf  Stream  regions  show  the  distribution  of  7-day  trajectories  starting  on 
10  December  2003.  A  pair  of  drifters  near  the  Gulf  Stream  off  Cape  Hatteras  is  shown  on  consecutive 
days  in  Figures  4c  (24  January  2003)  and  4d  (25  January  2003).  Trajectory  predictions  for  the 
northeastern  drifter  seem  highly  correlated  between  the  2  days,  while  predictions  for  the  southwestern 
drifter  are  distinct. 


estimates  separation  error  to  be  proportional  to  the 
equation  for  the  linear  fit,  and  a  square  of  the  correlation 
coefficient  R.  A  perfect  linear  fit  would  have  R2  =  1;  most  of 
these  cases  show  a  generally  linear  trend  with  R2  above  0.6. 

[24]  The  objective  of  this  study  is  to  determine  which 
model  configuration  leads  to  the  most  accurate  predictions 
of  drifter  motion.  The  tabulated  statistics  (Tables  4  and  5) 
indicate  that  NCOM  from  V2.5  most  frequently  has  the 
smallest  or  one  of  the  two  smallest  RMS  errors.  V2.5 
produces  the  smallest  RMS  error  in  60%  of  the  regions 
after  1  day  and  in  40%  of  the  regions  after  7  days;  it  is  one 
of  the  two  best  experiments  in  over  80%  of  the  regions  after 


both  1  and  7  days.  In  five  of  six  regions  with  Uy  below 
23  cms-1,  V2.Ga  is  the  top  version  after  l  and  7  days.  This 
suggests  that  the  importance  of  the  SSHA  correction  term  is 
relatively  high  in  regions  of  lower  variability.  The  SSHA 
correction  alters  the  mean  currents,  which  is  relatively  more 
important  if  variations  about  the  mean  are  small. 

[25]  V2.5  was  also  not  among  the  top  performers  in  the 
Kuroshio  region;  V2.5a  produced  the  smallest  errors  after 
both  i  and  7  days.  V2.5a  performed  relatively  better  in 
regions  with  larger  indicating  that  both  higher-resolution 
SSH  fields  from  NLOM  and  an  SSHA  correction  term 
contributed  in  these  areas.  Recall  that  the  correction  term 
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Table  4.  RMS  Separation  (km)  After  l  Day  Between  Observed  and  Simulated  Drifter  Trajectories  for  Model  Experiments  in  2003* 


Region 

Persist,  km 

V2.0,  km 

V2.5,  km 

V2.0a,  km 

V2,5a,  km 

Clim,  km 

rtu  cm  s  k 

n  Pairs 

Celtic- Biscay-North  Sea 

16.55 

15.53 

1163 

13,76 

1338 

16.21 

19 

2,819 

Iberia  Region 

10.89 

11.72 

1035 

1032 

10.36 

11.71 

19 

2,843 

Humboldt  Current 

12.60 

1 1 .85 

11.29 

10.73 

1L20 

1  L53 

21 

6,550 

Eastern  North  Pacific 

14.75 

14.67 

12.94 

12.78 

12.91 

14.38 

22 

6,420 

Brazil  Malvinas  Confluence 

17.81 

16,74 

15,31 

1536 

15.28 

16,77 

23 

13,349 

Gulf  of  Alaska 

13.52 

13.90 

12.12 

1232 

12.31 

13,70 

23 

2,371 

Benguela  Current 

17.15 

16.76 

1532 

15.89 

15  46 

15.77 

24 

3,292 

Black  Sea 

17  00 

16.96 

16.02 

16.15 

16.0 1 

16,03 

24 

1,130 

Australia-New  Zealand 

18.26 

16.90 

1531 

15.40 

1536 

16.66 

25 

4,459 

Central  Pacific 

22.20 

17.00 

16  13 

16.06 

16,17 

18.68 

26 

7,855 

Gulf  of  Guinea 

18.90 

17.40 

16.65 

17.90 

17.75 

17.24 

28 

5,182 

Equatorial  Atlantic 

16.42 

15.14 

1430 

14.67 

14.78 

1465 

29 

15,607 

North  Atlantic 

17.92 

17.71 

15.91 

15.90 

16.06 

17.30 

29 

41,155 

Pacific  Islands 

23.60 

18.82 

1730 

1838 

18.44 

20.44 

29 

36,512 

Japan/East  Sea 

21.61 

20.82 

1836 

1930 

19.42 

19.76 

30 

1,646 

South  China  Sea 

33.63 

24,64 

22.40 

23.79 

2324 

26.95 

30 

2,793 

Tehuantepec 

25.50 

19.14 

17.82 

1835 

18,23 

22.10 

30 

9,537 

Equatorial  Pacific 

24.45 

19.18 

18.50 

1832 

19.22 

20.57 

32 

44,482 

Indian  Ocean 

25.20 

21.67 

19.77 

20.77 

19.90 

25.40 

32 

15,661 

Java  Sea 

26.75 

26.31 

2437 

26.75 

25.92 

24.64 

32 

1,039 

Intra-Americas  Seas 

19.67 

18.76 

17.20 

17.66 

17.21 

19.13 

33 

6,250 

Agulhas 

29.27 

24.77 

2230 

22.70 

2230 

26.95 

34 

5,971 

East  Asian  Pacific 

32.12 

24.20 

22.10 

23.03 

22 43 

25.71 

34 

5,111 

Madagascar 

30,62 

26.76 

24.77 

25.34 

2432 

26,29 

34 

990 

Kuroshio 

24.67 

22.55 

20.41 

2037 

2033 

22.44 

35 

5,456 

Taiwan 

31,76 

24.98 

2233 

23.15 

2137 

25.22 

35 

3,201 

North  Brazil  Current 

19.74 

17.68 

17.49 

1737 

17.80 

18,09 

36 

2,743 

Arabian  Sea 

27.90 

23.78 

21.11 

22.50 

21.75 

28.68 

38 

2,978 

Gulf  of  Mexico 

25,53 

22.88 

2132 

22  J  5 

21.75 

23.58 

38 

546 

Gulf  Stream 

23,49 

22.66 

20.22 

20:76 

2031 

21,81 

38 

3,499 

Top 

0.00 % 

0.00 % 

60.00% 

26.67% 

16.67% 

333% 

In  top  2 

030% 

0.00% 

8637% 

43  33% 

6030% 

10.00% 

*  Regions  are  sorted  by  increasing  square  root  of  velocity  variance.  For  each  region,  the  most  accurate  simulation  results  art  in  bold-italic,  while  the 
second-place  results  arc  in  italic.  The  last  two  rows  summarize  relative  experiment  performance,  indicating  the  percentage  of  regions  in  which  each 
experiment  produces  the  best  (bold-italic)  or  one  of  the  two  best  (italic)  sets  of  results. 


used  in  V2.5a  was  originally  calculated  and  applied  using 
the  1/16°  NLOM  for  V2.0a.  Corrections  based  directly  on 
the  1/32°  NLOM  fields  have  not  yet  demonstrated  sufficient 
overall  performance  to  be  incorporated  in  the  operational 
systems. 

[26]  After  7  days,  V2.5  tell  out  of  the  top  pair  in  four 
regions  that  had  reported  high  performance  after  I  day: 
Japan/East  Sea,  Gulf  of  Mexico,  Java  Sea,  and  North  Brazil 
Current  In  the  first  two  of  these,  V2.5  was  the  top 
performer  at  the  24-hour  mark.  All  have  smaller  than 
average  sample  sizes,  with  fewer  than  1000  pairs  in  the 
Gulf  of  Mexico  and  Java  Sea.  In  the  Japan/East  Sea,  Java 
Sea,  and  Benguela  Current,  climatology  is  the  top  performer 
after  7  days,  indicating  that  model  skill  for  longer  trajectory 
predictions  needs  to  be  improved  in  these  regions.  Clima¬ 
tology  was  the  best  model  only  in  the  Java  Sea  at  the  24-hour 
comparison. 

[27]  Why  does  V2.5  perform  relatively  poorly  in  some 
regions?  The  SSHA  correction  appears  significant  in 
regions  where  V2.0a  or  V2.5a  performs  best.  After  both 
1  and  7  days,  V2.0a  yields  the  most  accurate  trajectories  in 
the  Humboldt,  Eastern  North  Pacific,  North  Brazil  Current, 
and  Brazil-Malvinas  Confluence  regions.  V2,5a  has  the  best 
performance  in  the  Kuroshio  in  both  cases  and  in  the  Gulf 
of  Mexico  after  7  days.  Higher  NCOM  resolution  is  needed 
to  resolve  the  circulation  in  the  Java  and  Japan/East  Sea. 

[ir]  Figure  5  helps  put  the  comparison  statistics  in 
perspective.  The  panels  from  top  to  bottom  show  a  clear 


progression  from  a  worst  case  of  persistence,  somewhat 
better  results  using  climatological  currents,  and  further 
improvement  using  V2.0.  While  the  summary  statistics  on 
the  bottom  lines  of  Tables  4  and  5  strongly  indicate  that 
V2,5  produces  the  best  overall  results,  the  linear  regressions 
in  Figure  5  suggest  that  while  V2.5  is  the  best  case, 
performances  of  V2,0a  and  V2.5a  are  not  too  far  behind.  In 
fact,  at  the  precision  shown,  the  regression  curves  for  V2.5 
and  V2,5a  differ  only  in  the  7-day  comparison  (Figure  5j), 
where  V2.5a  has  a  slope  of  3.30  kmscnf 1  versus  a  slope  of 
3.28  km  s  cm-1  for  V2.5,  All  three  cases  clearly  produce 
more  accurate  currents  than  V2.0. 

6.  Conclusions 

[29]  Drifter  trajectories  simulated  in  a  set  of  modeling 
systems  are  compared  with  observed  trajectories  as  one 
aspect  of  a  validation  study  to  determine  which  alternative, 
if  any,  would  be  the  best  upgrade  for  the  existing  model 
configuration.  What  do  the  evaluation  results  in  Tables  4 
and  5  reveal  about  the  relative  performance  of  the  initial 
operational  version  of  NGOMS,  V2.0?  In  the  1-day  trajec¬ 
tories,  it  was  no  better  than  third  place  in  any  of  the  30 
evaluation  regions;  in  the  7-day  comparisons,  it  managed  to 
finish  in  second  place  twice.  V2.0  was  never  the  best  case. 
The  results  support  a  decision  to  upgrade  V2.0  with  one  of 
the  alternatives. 
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Table  5,  RMS  Separation  (km)  After  7  Days  Between  Observed  and  Simulated  Drifter  Trajectories  for  Model  Experiments  in  2003* 


Region 

Persist,  km 

V2.0,  km 

V2.5,  km 

V2.0a,  km 

V2.5a,  km 

Clim,  km 

On  cm  s~{ 

n  Pairs 

Celtic- Biscay-North  Sea 

SO.  3  2 

68.77 

65.72 

66. 11 

66.24 

77.79 

19 

2,665 

Iberia  Region 

57.44 

58.68 

55.69 

53.71 

55.82 

62,92 

19 

2,636 

Humboldt  Current 

69,03 

61.32 

62.46 

58*36 

61.69 

60.27 

21 

6,081 

Eastern  North  Pacific 

78.38 

74.80 

70.19 

68.00 

70.34 

76.03 

22 

6,063 

Brazil  Malvinas  Confluence 

94.17 

85,73 

81.43 

79.84 

82.14 

85.85 

23 

12,885 

Gulf  of  Alaska 

69.56 

68.11 

63.84 

62*89 

66.20 

71,10 

23 

2,135 

Benguela  Current 

94.56 

93,29 

86.28 

89,15 

86.47 

83*14 

24 

2,984 

Black  Sea 

82.37 

78.37 

74.02 

75.81 

73*80 

74.92 

24 

1,065 

Australia-New  Zealand 

99.67 

87,78 

85.20 

85.63 

85*01 

87.00 

25 

4,240 

Central  Pacific 

134.11 

95.09 

9 2.80 

91*12 

93.36 

105.9! 

26 

7,572 

Gulf  of  Guinea 

109.99 

95.20 

92*22 

103.06 

99,38 

97.75 

28 

4,754 

Equatorial  Atlantic 

94.80 

82.27 

79*22 

81.66 

81.84 

80*9! 

29 

15,005 

North  Atlantic 

94.32 

89,28 

84.23 

84*06 

84.70 

90,35 

29 

40,273 

Pacific  Islands 

140.85 

106.80 

103.28 

105.76 

106.03 

115,74 

29 

35,335 

Japan/East  Sea 

104,20 

95.07 

93,12 

92.43 

95.67 

9M8 

30 

1,501 

South  China  Sea 

188.64 

131.29 

123.42 

128.27 

128.47 

152.24 

30 

2,423 

Tehuantepec 

150.03 

97.79 

91.58 

91.81 

95.13 

123,46 

30 

8,805 

Equatorial  Pacific 

148.34 

107.71 

104.93 

107.01 

109,66 

117.06 

32 

42,777 

Indian  Ocean 

147.17 

125,56 

112.75 

120,26 

113.42 

139.44 

32 

14,937 

Java  Sea 

143.68 

144.97 

140,63 

148,73 

136.13 

130*98 

32 

817 

Intra-Americas  Seas 

105.91 

102.02 

94.75 

99,44 

94*20 

102.79 

33 

5,853 

Agulhas 

154.05 

124.91 

114.81 

116.71 

114.87 

129,85 

34 

5,431 

East  Asian  Pacific 

182.58 

127.44 

120.29 

125,92 

122.82 

140.72 

34 

4,715 

Madagascar 

168.12 

147.35 

132.31 

137.49 

129.85 

134.52 

34 

757 

Kuroshio 

131.71 

120.83 

114.84 

112.07 

111.90 

119,03 

35 

5,086 

Taiwan 

178.03 

136.98 

130.44 

130.67 

124.73 

136.28 

35 

2,711 

North  Brazil  Currcni 

107.38 

95.43 

96.93 

92*37 

96.95 

97.39 

36 

2.499 

Arabian  Sea 

170.71 

140.63 

123.16 

132.14 

126.26 

172.62 

38 

2,622 

Gulf  of  Mexico 

I0L50 

110.91 

101.83 

110,70 

100*91 

107.91 

38 

445 

Gulf  Stream 

12L01 

114.08 

101.60 

111.67 

105.08 

110.81 

38 

3,164 

Top 

0.00% 

0.00% 

40.00% 

26.67 % 

23*33% 

10*00% 

In  top  2 

123% 

6.67 % 

80.00% 

50.00% 

43.33% 

16*67% 

‘Regions  are  sorted  by  increasing  square  root  of  velocity  variance.  For  each  region,  the  most  accurate  simulation  results  are  in  bold-italic,  while  the 
second-place  results  are  in  italic.  The  last  two  rows  summarize  relative  experiment  performance,  indicating  the  percentage  of  regions  in  which  each 
experiment  produces  the  best  (bold-italic)  or  one  of  the  two  best  (italic)  sets  of  results. 


[30]  Each  of  the  proposed  alternatives,  V2.0a,  V2.5,  and 
V2,5a,  generally  produced  more  accurate  predictions  of 
drifter  motion  than  did  V2.(X  supporting  our  hypotheses  that 
improved  NLOM  resolution  or  more  accurate  treatment  of 
the  (SSHAMOdas-~SSHAnlom)  within  the  NGOMS  would 
produce  a  better  operational  product.  Do  the  results  indicate 
a  preference  for  one  of  the  alternatives?  After  7  days,  V2.5 
was  the  top  performer  in  40%  of  the  regions  and  among  the 
top  two  in  80%  of  the  regions.  Considering  the  1-day 
trajectories  that  are  more  operationally  relevant,  the  relative 
performance  of  V2,5  improved:  It  was  the  top  performer  in 
60%  of  the  regions  and  among  the  top  two  in  86%.  No  other 
version  was  the  top  performer  in  more  than  27%  of  the 
regions  or  among  the  top  two  in  more  than  60%  of  the 
regions  in  either  the  1  -day  or  the  seven-day  comparisons. 
Figure  5  shows  that  V2.5  has  the  smallest  slope  in  the  linear 
regression  of  RMS  separation  versus  av  for  both  I  -  and  7-day 
comparisons.  These  results,  combined  with  additional  stud¬ 
ies  by  NRL  and  NAVOCEANO  not  shown  here,  support  the 
decision  to  upgrade  the  operational  NGOMS  to  V2.5.  The 
extensive  observational  drifter  data  allowed  a  robust  region¬ 
al  evaluation  using  simulated  drifter  trajectories. 


[3i  |  While  the  perfonnance  rankings  in  Tables  4  and  5 
indicate  a  clear  preference  for  V2.5,  Figure  5  shows  that  the 
performances  of  V2.0a  and  V2.5a  do  not  lag  far  behind. 
Even  though  the  (SSHAMOdas-$SHANLOm)  correction 
term  used  in  V2.5a  did  not  lead  to  an  overall  improvement 
relative  to  V2.5,  the  success  of  such  a  correction  in  improv¬ 
ing  V2.0a  relative  to  V2.0  suggests  that  an  appropriate 
correction  term  could  lead  to  significant  improvement,  A 
test  case  using  a  preliminary  SSHA  correction  field  calcu¬ 
lated  using  the  1/32°  NLOM  means  (not  shown)  did  not 
perform  as  well  overall  as  did  V2,5a,  demonstrating  that  an 
insufficiently  accurate  correction  field  can  do  more  harm 
than  good.  Some  work  is  underway  that  may  lead  to  a  more 
accurate  SSHA  correction  or  alternate  methods  to  produce 
more  accurate  synthetic  profiles  for  assimilation  into  ocean 
models.  Steric  height  anomalies  calculated  from  historical 
observations  are  being  paired  with  SSHA  from  NLOM  or 
with  SSHA  from  altimeter  data  processed  to  remove  the 
nonsteric  signal.  Additional  efforts  are  underway  to  produce 
more  accurate  synthetic  temperature  and  salinity  profiles, 
providing  new  capabilities  to  account  for  salinity  variations 
independently  from  temperature  variations  as  suggested  by 


Figure  5,  Summary  of  RMS  separation  (in  kilometers)  after  1  day  and  7  days  between  observed  and  simulated  drifter 
trajectories  for  model  experiments  in  2003.  Each  panel  shows  a  linear  fit  to  the  data,  which  estimates  separation  error  to  be 
proportional  to  the  square  root  of  regional  velocity  variance.  Results  fromV2,5,  the  experiment  with  the  smallest  errors 
overall,  are  included  in  each  panel  for  reference. 
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the  results  for  the  Alaska  Stream,  As  higher  model  resolu¬ 
tions,  more  accurate  synthetic  profiles,  more  sophisticated 
data  assimilation,  and  other  system  improvements  are  devel¬ 
oped,  next-generation  systems  can  be  evaluated  using 
simulated  and  observed  drifter  trajectories  to  determine 
whether  or  not  the  new  capabilities  deliver  improved 
performance. 

[32]  Prediction  of  drifter  trajectories  will  always  be  lim¬ 
ited  by  dynamics  unresolved  in  time  and  space,  such  as  the 
phase  of  inertial  oscillations  and  turbulence  in  the  velocity 
field.  The  observed  drifter  is  a  sample  among  many  possible 
outcomes  which  would  result  from  slight  perturbations  in 
time  or  space.  The  problem  is  illustrated  by  Figure  4d  in 
which  the  observed  and  simulated  drifter  trajectories  move 
in  opposite  directions.  A  discussion  of  two-dimensional 
turbulence  by  Haller  and  Yuan  [2000]  describes  that 
Lagrangian  definitions  for  the  boundaries  of  coherent  struc¬ 
tures  can  emerge  in  turbulence  for  finite  periods  of  time, 
unresolved  vortices  whose  impact  is  better  represented  by 
tracer  dispersion  than  single- particle  advection,  Prediction 
of  drifter  fate  in  subsequent  evaluations  might  be  better 
represented  as  a  probability  distribution  from  a  cluster  of 
simulated  drifters,  each  seeded  with  slightly  perturbed  seed 
time  and  initial  location.  Similarly,  large  numbers  of  drifter 
observations  are  required  for  evaluations  since  a  single 
trajectory  realization  may  not  be  a  good  indication  of  the 
most  likely  fate  of  a  cluster  of  drifters. 
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